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IDENTIFIERS 
ABSTRACT 

Professors- in the On^iversity of Pittsbqrgh School of 
Education were invited by the Venezuelan Ministry of Education to 
develop a seminar following three general objectives: (1) obtain 
points of theoretical reference about the evaluation of personnel, 
curriculum, and institutions, (2) present an' overview of principles, 
problems, and examples of methodologies of evaluation, and (3) apply 
theory, models, and instri^ments to the educational situation in 
Venezuela* These objectives were "addressed in 19 sessions where an 
effort was made to provide an in-depth focus on a limited number of 
evaluation technTques while providing relevant theoretical coverage. 
Problems faced included addressing the sessions to 'tlie different 
levels of sophistication of the participants, conducting the sessions 
in a building with a high noise level and uncomfortable seats, and 
maintaining seminar continuity for participants with work conflicts. 
The seminar was generally viewed as a meaningful first step in the 
training of Venezuelan evaluators. The United States/Venezuela 
partnership in financing this special program was deemed positive. 
(BJG) 



/ 



V 



FINAL REPORT 

Evaluation of Personnel, Institutions, and Curriculum 
Caracas—July^ 1-31, 1970 
Contract rib: AID-529-222-T 



EOUCAT.'O'* 



Submitted by! 



CO • 

o 
o 



Dr. Paul E. Watson 
Dr. Thomas \. Hart 
Dr, Rolland G. Paulston 
Dr. James Mauch 



) PAliT I 



PREPARATIOI^S 



Acknowledgements ^ • ' ' ' >sj^' 

From the beginning of discussions to th^ completion of this, report, ' 
w^have been indebted to a great many people. On campus, specific help 
came from graduate students in IDEP; Miss Carol Jones, IDEP Secretary; 
personnel of the fiscal office of- the Center -for international Studies; 
and the Book Center. The instructors were released from their normal 
duties for the seminar thanks to the interest and understanding of 
Dr. Paul Masoner, Dean of the School of Education, and Dr. John Singleton, 
Chairman of IDEP. Colleagues in IDEP, UCIS, and the Office of Research 

t 

and Field Services had to take up the slack caused by four man-months^ 

of absence from campus. 

In Venezuela similar support was received from personnel of USAID/V 
and the Ministry of Education. Secretarial and general services staff of 

< 

USAID/V were extremely helpful during the seminar in last minute trans- 
lations, production of instructional • materials from stencils prepared 
in -Pittsburgh, travel arrangements, etc.- Mr. Eldon Stewart, Chief of 
Human Resource Development was always actively engaged in our behalf 
and his preparatory arrangements were particularly appreciated. 

The Ministry of ^ucation through Dr. Aristobolo Petta, had prepared 

,for\he seminar quite thoroughly. We particularly appreciated the 



the support and gu'.idnnce received f^om.Lic. Francisco Tugues and 

Lie- AdelaGosen. 'MissGosen served a. 'seminar, assistant throughout the 

f ' • ■ 

month.* ^' ♦ 

Vovke facilities and ancillary support, we were indebted to ' 
Prof. Felipe Medina and his staff at the Instituto de Mejorpiiento . 

• Finally, we greatly appreciated the acceptance we experienced ^ . 
by the seminar participants. Their personal kindnesses and professional 
support made-the seminar an extremely positivc<eyerience* for us. ^ 

\ 

f '' ' ^ 

Rationale 

The S-EPic Workshop on Methods of Educational Evaluation necessitated 

• a great deal of 'work to plan'' and carry out. The. four University " of 

Pittsburgh professors who participated in^this technical-assistance 

effort he.ve justified their investment of time and effort as follows: 

. ■ 1) The need to respond to a new government's request for expert " 

. - i^^^^t-nno p fledeline Control and Evaluation Division 
assistance in implementing a tieagiiug -^uhcl ^ ^ ^ 

in the Ministry of E^tion. This encouraging organiktional , 
innovation holds no uTtle promise for the qualitative improvement 
of Venezuelan education if evaluation staff can be properly trained 
and cfeployed. This we helped to do . 

2) AS professional studepts of national development, we are 
interested not only in professional capacitation, but also in. the 
process of cross-cultural efforts to seek directed change-bo*^ 
qualxtative and quantitative-in third-world educational systems. We 
question, for instance: if the assistance r-equested is feasiole; and 
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.if so, under' what conditions? This 'analysis continues. 

3.) A third- thread in our rationale is to support our University's 

, efforts to forge fruitful ' professional and academic links with cognate 
third-world itistitutions. This attempt^is seen as contributing to 2) , ^ 
above as well as "io the potential for collaborative researfch, p:;of essorial 
colldgial' relationships and placement of our graduates in consultative 
and long-term development education positions. 



Preliminary Planning 

Planning for the evaluation seminar began in November 1969 wit^n 
Dr. Watson's conversations with F.DIJPLAN concerning- their need for 
long-term technical assistan^TTn educational-evaluation techniques. 
Shortly thereafter, most educational ■ evaluation responsibilities were 
moved from EDUPLAK-which became Planeamiento , or Planning— over to 
thf; new Direccion de Control y Evaluaci'^n. 

At their request. Dr. Paulston spent three weeks exploring possi 
bilities for Pitt to help' the n'ew evaluation unit train its largely 
untrained staff. The Direccion requested a month- long workshop in 
July 1970, and Professor. Thomas Hart spent April and May in Caracas 
helping AID and the MEP plan this undertaking. 

Simultaneously, at the University of Pittsburgh, Drs. Pnulston, 
•Mauch, Watson, and Drugo began a new IDI-P Seminar on evaluating 
dirccted-change projects in development education ( see attached / 
copy). This experimental seminar met weekly,- and with the. help: of 
some seven graduate students di scussed problems, strategies, and 
tactics using the proposed SEPIC workshop as an illustrative case 
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Study. Staff and students prepared bibliographic materials, 
identified relevant data, and saw to the preparation, translation and 
the like of stencils, duplicated and reproduced materials, etc. With 
Dr. Hart's return. in late May, this IDEP Seminar concentrated almost 
exclusively on planning the content of the four weekly units. In all, 
over 120 -prof essorial man hours of workshop preparation took place in 
the seminar alone. 

It now seems likely that this seminar will become a regular coujrse 
offering and support the activity mentioned under our second general 
rationale. 

■s. 

Materials 

Because materials on educational '^valuation played such a crucial 
role in the workshop, tliey should receive separate, note. AID supplied* 
$600 for books on evaluation, while the University of Pittsburgh spent 
$500 on evaluation materials in Spanis . translation. In addition the 
IDEP contributed well over $200 of its budget to Xerox costs, and the 
IDEP staff worked many extra hours on project details. 

All of these books and materials arc nowlocated in a special 
library in the offices o^f . Direccioii de Control^ y Evnluacion and 
Minist^rio de Kducacion, a 'specialized library probably without equal 
in all of Latin America. , / 
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Staff and Partici 3i\ts 

Four professors from the University^f Pittsburgh spent the month 
of July in Caracas at the Instituto de Mejoramient^ Profesional at 
Dos Caminos. Drs. Hart and PauJsto n represented Ii^EPj Dr. Watson, 
IDEP and UCIS; and Dr*. Mauch, the Office of Research and Field 
Services. , All' are Professors in the Univ »rsi ty .of Pittsburgh School 
of Education. * 

Consultation on individual evaluation problems and concerns took 
place during, the mornings and after class, xWiich held*from 2 p.m. 
till 5:30 p.m. Staff costs were equally divided between USAID arxl the 
Venezuelan Ministry of Ediacation. 

- The forty workshop participants represented 'over ten Venezuelan 
organizations.' (See -invitat ion and list attached).* 

. ■ ) 

They . comprised a heterogenous group that rather soon divided into 
two sections: the first characterized by expertise and interest in, 
educational e/aluation, the second by little or no knowledge of the topi 
to be covered. VJith the bi-polar nature of the group determined in the 
first day or so, it was possible to adapt better our instructional 
methods, activities and content so as to maximize participation, 
interaction, and'^learning . Something of our attempts to this end can be 
illustrated with a brief review of objectives and activities during 
each of the seminar's four weekly units. 

Before we mov.e. on to content, we might first observe that the 
workshop was suitably inaugurated with wise words — and excellent 
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champagne — by. the Director General of Education, Dr. Pedro Contreras 
on August 3. Dr. Contreras stressed the need for this seminar and 
urged all the participants to make the most of this opportunity. He 
was emphatic;.^^^ his stress on adapting methods and techniques to 
Venezuelan reality and problems; the need to develop Venezuelan education 
by and for Venzuelans. 



ERIC 
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Preplanning Documents 
(see Apperidix 1) 



1.1 IDEP Seminar 

1.2 Invitation to Participating Institutions (SEPIC) 

4 

1.3 Proposed Participants (SE^IC) 

1.4 List of Instructional Materials Purchased (AID support) 



PART »II 

THE SEMINAR AND RELATED ACTIVITIES 



Introduction r * . » 

The Ministry of Education had dWeloped the following geaeral 
objectives for the Seminar: . * * , 

1. Obtain points of theoretical reference about tbe evaluation of 
personnel, curriculum, and institutions. 

2. 'Present an overview of principles, problems, aiad* examples of 



of evaluation 

models, and instruments to the .educational situatioi 



methodologues 
3. Apply theory, 
in Venezuela; 

Clearly in-d^epth coverage of eva'luation theory, method, and instru- 
mentation was impossible during the nineteen sessions available for the 
j^minar. The instructional staff dfecided on three broad operational ^ 
objectives for the conduct of the seminar. They were: 

1. To provide only specifically re'levant .theoretical coverage* 
and give participants the capacity to use a limited number of 

^methods and instruments over a reasonably broad spectrum of 
evaluatLoh concern.s and 

2. To^-l^ave behind carefully selected ideas and supporting'materials 

C' ' . * 

calculated to create a long term effect of presence ta .add to ' 

the immediate impact of seminar sessions. 
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•3. To enhance the potential for both immediate and long-term 
,,/^ect by working closely with individuals arid small groups . , 

/ 

with special interests. • / ^ 

' Another major cor;cern was frankly pedago/ical. The instructors 
decided upo'n a gener'all!. informal style of presentation and discussion 
and upon the use of a wide variety of .teaching raethods. As will be 
noted in subsequent sections of this report, the methods used included 
a great deal of sm^l group work on- specific topic, and problems; . 
roleS^ying; mini-'pse studies; short lectures, etc Too, it was ^ 
decided to search for and utilise times and places in which the varied , 
talents and information bases o^ participants could be' used as instruc- 

-\ > . / * , » 

tional inputs; > 

W9 were fortunate that tha make-up of th^ seminar group' was such 
that the instructional task was generally rewLrding- and that help from 
the -group was alway^ available and cjieerfully given. -. 

. The seminar was officially opened on July 3 at 4:00 prm. w^th 
charges to the group being made by Professor Pedro Contreras, Director 
cVral of Education. (See Appendix 1.1 for Inaugural Program outline). . 

The first working session began at 2:00 p.m, on July 6 and Included, 
as introduction,' a short formal talk (Appendix 1.5).andthe following 
announcement s : 

1. -.-The instructional staff is available, as individuals or- as a 

t\am. to meet with participants 'each morning 'and after seminar 
session ends *t 5:30 p.m. We will meet at the seminar site 
or in places of work." - 
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2. "Recognizing the heavy work responsibilities of the participants, 
we will not come to places of wprk without specific invitation. 
Please make any invitation spe9ific as to hour, and expected 

' contribution/* ' " ^ . , 

3. "Unless otherwise' committed >to work with participants at other 

locations, -the instructors will be at the seminar site from 
J" » ♦ 

10:00 a.m. each morning until the sciietluled hour for convening 
the afternoon session for consultation or conversation about 
specific and indiviclual cdncerns."- ' . . * 

4. "Please bring any documents, instruments, or statements of t-ssksj 
whihh you may wish to be par/t of the content of the seminar 

or which you feel would acquaint the instructors with Venezuelan 
reality as related to evaluation."* 
In addition our living acjdress and tt:lephone number were given 
o the participarits. 

The instructors were introduced to the participants and the seminar 
egan its month of work. ' . ' 
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Introductory Documents 
(see Appendix 2) 



2 1 Programas Para la Inauguracion 

2\2 SEPIC Programa General 

2.3 Planilla de Inscripcion 

2. A SEPIC: Participantes del Bla 

2.5 Introductory-Remarks: SEPIC, July 3^970 
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EVALUATION OF EDUCATIONAL RERSONNEL 

The Seminar on Evaluation of Personnel, Programs, and InsVitutions 
began formal class activities Monday afternoon, July 6, at the Instituto 
de Mejoramiento Prof esioiial. Average daily attendance this week was 
34 participants and the four instructors. 1 . 



Objectives 

' 1. Presentation and orientation to seminar group of general pur- ^ 

f 

poses, pflLan of work, and questions about the reality of education 
in Venezuela. This orientation included effective methods to 
help introduce the instructors to the .participants and the 
I , participants to each other and the instructors. 

2. To present in general terms a point of view about personnel 
evaluation, actions! problems, potentials, and background 
information. ^ 

3. Develop skill and ^bii,ity to utilize instruments and techniques 
for the evaluation of educational personnel. 

Since-^the seminar .group was found to be heterogeneous in a^cademic 
background, experiei^ce and professional .responsibilities, it was necessary 
to make the present'atlonsof the first week reach the majority middle 
level. This brougiit on some criticism but enabled the instructors to 
gain a rapport and stimulate interest and verbal exchanges with parti- 
cipants. 
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Subjec\ts and Topics Covered 

Personnel Evaluation ^ ♦ 

1. Criteria for Selection 

These included a presentation and critical analysis of 
instuments and procedures " developed and to be put into us6. 

2. Criteria for evaluating teachers in action. Emphasis was 

V • ' , . . . 

placed on classro6m performance as the key activity in 

teaching . »• 

3. The 'dysfunction of any set of sanctions 'was stressed. Instead 
the positive approach through better selection o^ teac'hers 

^ wast presented as a means of upgrading and prof essibnalizing 
^ the teacher corps. 

^ 

Methods and Activitlas 

' Methods used during the first wpek were lectures; socio-djama or • 

role playing in which four participants took teadier-supervisor and . 
peer responsibilities to illustrate good and poor personnel evaluation 
techniques; work in small grips on assigned topics, and the distributing 
of bibliographical materials for reading and discussion. 
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MATERIALS PRODUCED AND DISTRIBUTED 
(see Appendix 3) 



-1^ 



First Week ' 
Title 



Personnel Evaluation 



3.1, Un punto de vista de lo que es 
supervision — Falk \. 

3.2 La conf erencia .individual-7-Falk 

3.3 Un progranta de evaluacion — Falk 

3.4 Conftirencia de Grupo — Falk 

3.5 La Evaluacion y su iraportancia y 
para el supeivisor — Guerra 



3.6 Visitas a las clases: Supervision — Falk 

3.7 gvaluacion de Supervision — Falk 

3.8 Direccion y Administraci6n de 
Personal - Pigors y liyers <■ 



Pages • -//Distributed 



18 

8 

29 
10 
23 

17 
21 
33 



40 

40 
40 
40 
40 

40 
40 
40 
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SAMPLES OF GROUP WORK—FIRST WEEK 
(sec Appendix 4) 



/ 



Titled 



4,1, Criterio de diseno ^ 

Programa: Evaluacipn del'^ 
/sistema de iv:omoQion automatica 
por asistencia en 1, 2 y 3 grado 
^ de primaria 



4,3 



4.4 



4.5 



4-6 



Creacion^de la Ofieina de 
Educacion de Adultos 

Evaluaciokde un Profesor 
de Biologia—Area Rendimiento 
en el Aula 

/ y 

Evaluacion de la actuacion 
del Profesor en el aula 

Instrumento de EvaluaciOn para 
un profesor de asignatura 

Evaluacion de un grupo dejnaestr 
de primer grado, que enser?an a 
leer, para seleccionar la que 
tenga condiciones optimas para 
cubrir un cardo de maestra 
asesora o coordinacioti 



is 



' G roup 

ConJ:rol y 
Evaluacion 
de Pena 



Comtsion de 
Evaluacion 

//I 



16 



A 



Outcomes — Expected and Others 

One of the important outcomes of this seminar^lJ^s the noted change 
in attitude toward evaluation. Feedback from participants through 
third parties in the Ministry of Education indicated that participants 
have changed in attitude from resistance and misunderstandings about 
eval)jation, particularly personnel evaluation, to acceptance, understanding 
and lesser feelings of insecurtiy. This was due, in part, to the oppor- 
' tunity given the participan^ts each weelj to evaluate the seminar and the 
staff. The public analysis of these evaluations and the positive attitude 
\ 'of the instructional staff helped to gain the confidence of the 

participants in the value 'and use of evaluation procedures. 

Group work, in the ma-'n, was dedicated, effective, serious, and 
meaningful. There was a concerted willingness to work and cooperate 
in producing meaningful results. 

N An unexpected outcome was that one group, selected by a Ministry 
representative (as were all the first groupings) turned out to have in 
it'only one .man, who tried to dominate the group. This produced some 
friction and requests for regroupings. The regrouping was accomplished 
during the second week. 



\ 



Appraisal 

The criticisms voiced and written about -evel, techniques and 
content by the participants in their evaluatix>n of the first week of 
work were valid for the instruct ioiTal staff. This helped us to me^ct 
these criticisms and suggestions by putting more emphastls on content, 
instruments and methods of evaluation. 
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'A participant who attended most of the sessions described the 
atmosphere of the seminar-workshop as flexible and relaxed* One 
difficulty he observed was the diverse backgrounds of the participants. 
Reactions' to specific presentations or matefials were highly indivi- 
dualized because of these differences, .Orie exception to this disparity 



wa 



s that most participants felt the meeting place was inadequate and 



extremely noisy, 

Resultis of formal evaluation are show in the foijowing charting: 



\ 



A scale of 1 to 5 was used with 1 being the most positive response". 



Category 1- Methodology of presentation arid orientation including plans 
of work for seminar and questions on the educational realities 
in Venezuela. 

# 39 responses; median 2.2 

Range 1 to 4 ^ ' , ' 

Mode 2 

Category 2. To present', in general, point of - view on evaluation, 
problems, potentials and antecedents, 

26 responses; median 2,5 

Range 1 to 5 , . 

Mode 2 ^ 

Category 3. Develop skills in using techniques and instruments of 
personnel evaluation, 

24 responses; median 2,8 ^ 

Range 1 to A ^ ' . . , . 

Mode 2 and 4 \ ' * ' 
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EVALUATION OF PROGRAMS 

Objectives 4 

The second week's work was devoted to helping the participants to ^ 

1. ) gain knowledge ami -uaderstandingf* of what evaluation is and 
the state o.f the art;, 

2. ) develop a theory of evaluation under which principles and 
models could be consistently and systematically applied; 

3. ) develop and apply va*riou§ models critically, flexibly, and 

' sensitively to educational programs and the projects in Venezuela. 

4. ) apply an ev^^luation system to the work ^of the second week. 
These objectives »wer6 specifically focused on evaluation of 

educatj.pnal programs and projects of immediate inr<ftrest and importance 
to Venezuelan educators. 

Objectives in Spanish were passed out, discussed, and agreed-upon 
the first day of the second week. 

/ The staff, in assessing its accomplishments duri-ng this first 
week of work, agreed in most instances that we had accomplished the 
objectives set. We also agreed that the participants* criticisms were 
valid and useful to us for the planning of the remaining three weeks^ 
of the seminar. Apparently the approach of the first 'week had been\^ 
effective in "breaking the ice"' and,.JLn„.s.etting/ the stage for much less\^ 

i i 

formal presentation than is usual or customary in the Venezuelan 



environment . 
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'Subjects and Topics Covered 



/ 

The subjects and topics covered are listed in Appendix 5 under 
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"Segunda Semana: Evaluacion de Programas," dated July 13, 1970. 

The many reports and inf ormes distributed and discussed are also 
listed in the appendix. Generally, information and lecture material 
were given out in Spanish at the beginning of every new topic, or the night 
before if the reading required was long. 

In the first topic, an attempt was made to develop a theory of 
evaluation, not as a rubric or pronouncement btrtr as a proposal to be 
criticized, discussed, and hopefully improved. 

The process and utility of a theory was first discussed, then the 
assumptions necessary to its development. One of the assumptions was 
a specific def inition\)f evaluation, proposed useful for the purposes of 
Venezuelan education. The seminar discussed the uses to. which the 
theory could be put and its applicati^ to Venezuelan programs. It 
was pointed out and demonstrated, for example, that different kinds 
of needs would demand various evaluation procedures/ 

There was considerable stress placed on the major proposition 
advanced that evaluation is intended to enhance and make more systematic 
and precise the decision-making process. / 

A major task of evaluation was scan as ascertaining the critical 
areas of concern. The point of >;iew enhanced by the seminar was that tlie 
decision maker and not the evaluator determine what will be examined 
and evaluated. The evaluator's role nevertheless, frequently includes 
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challenging and stimulating a wider view of evaluation than may 
originally have been advanced . , ^ , 

The seminar then attempted to show a distinction between the design 
and uses of evaluation and research, evaluation fonns designed to provide 
the best possible basis for informed judgments and decisions and research 
designed to explain soine phenomenon. 

Another task of evaluation discussed was the selection of appro- 
priate data in light of the area to be considered. The task of the eval- 
uator includes the develVjpment of instruments. 

The task of collecting and analyzing the data will vary with the 
different problems of the programs being evaluated, and the nature of 
the particular decision-making context. 

Summary data was 'described as being most useful to the decision- 
^maker when it enables him to make sound decisions about alternative 
courses of action. This is the very |i^sence and purpose of the whole 
evaluation process. 

A second theme was th'i presentation and examinatior^ of the CEPP 
model. This explanation is contained in the Appendix, It is based on 
the assumption that to truly evaluate a program or project one has to 
know both the context in which the program started and operates, and the 
^'inputs* made to get the pT?^ogram started; or in the case ^ proposed 
pxograms, the resources, -proposed strategics, designs and objectives 
of each viable alternative. The end product of such input evaluation 
is an analysis of alternative procedural designs in terms of potential 
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costs and benefits. 

'once a designed course of action has been approved or has started, 
"process" evaluation is neede<3 to provide periodic feedback to the 
H^nagemen;.- The purpose of process evaluation is to detect during the - 
operation of a program or project defects in the design, management 
or even objectives of the operation. The record of^process i.nformation 
can also be used later for interpreting project outcomes. 

considerable discussion' of product evaluation is the end of the 
program-evaluation cycle used to determine .he effectiveness of the- 
program or project after it has been run f-ll cycle. ■ Its purpose i% to 
* measure and interpret outcomes in light of the context, inputs and 
processes of the project of, the program. The value of the end product has 
to be related td the objectives stated originally or as modified. . | • 

On the second day the CEPP model applicaClon was described in terms 
of an actual program currently being evaluated in Pittsburgh- the Teacher 
corps at the university of Pittsburgh. See Appendix 5-"Dise!to de " 
Evaluacio^n del Cue'rpo Docente, Modelo ' CIPP." This application went 
through ^ch step systematically marking the objective of each step, 
the methods of analyzing the model at each step, and the instrumentalieation. 
A list of variables to be examined with the instrumentation was also 
distributed. 
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Mcthcds and Activities Us ed 

The first day and a half were largely devoted to discussions and 

questions. After analyzing the effectiveness of th^e methodology in terms 

of Venezuelan educational programs and projects, many problems were aired. 

The participants were the helped to modify and augment the application of 

the model to their own needs. 

Following t.he opening theoretical development and, application, 

participants were divided into fouj: groups and requested to choose an 
educational program of interest and currency to them, then try to apply 
the model to determime its usefulness. The groups Worked separately after 
presentation of each model, often raising questions about the manner 
of applying the model, or modifying it so it could be applied. The results 
of their work can be seen in Appendix 6. The groups produced applications 
which were then mimeographed and critiqued. These critiques resulted 
in a deeper understanding of the ustfs and limitations of the models, and 
'the difficulty of applying the models where extensive instrumentation is 
needed. 

. other key activities ,during the second week included (1) a discussion 
of evaluation study design, principles and processes , (2) a description 
and application of the -Discrepancy, Evaluation Model , and (3) extensive 
•group work on the curt'cnt status and problems of ovaluntivc research 
in Venezuela. 
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Outcomes ' 

The participants demonstrated their understanding and knowledge 
of the evaluation process presented by sharp questioning of specific 
items and criticism of some of the bases or assumptions. For example, • 
debate ar9s7^r~7l^p7sition of the instructors/ i . e. evaluation exists 
p help decision-makers make better decisions , not .because someone needs. ^ 

ro know or is interested in fxplaining some phenomenon in the absence of 

J 

any immediate decision-m"&lfing purpose. 

As a, result of the discussion, a summary was prepared listing a 
number of uses which evaluation would s.rve (See Apppdixj "Algunos 
Puntos Claves de la Educaci«^n . ") ^ 

Another outcome, hoped for and evidenced, was the ability of 
participants to apply the model on their own when the seminar dealt 
with different topics during the third and fourth weeks. 

The participants also wished to develop the instrumentation phase, 
and in much of their work the instrumentation was quite spphisticated . 

(See Appendix 5) . 

Participants ^Iso asked for selected references of the CEPP and 
discrepancy models In order to be able to gain a degree bf broader 
understanding of the model for their own use and understanding after . 
the seminar. Thiii list of references Is also appended, cjated 
,Tuly H), 1970. 

T loose-leaf binder of some common eva^luation instrum^entsyand . their 
use was prepared and reviewed by participants. Members of the, seminar 



also brought instruments of their own and shared th^m with the teaching 
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staff for review nnd comnu^nt . - i 

One of the most encourafi'lnr, outcones '..-as'-the critical attempt by 
participants to evaluate the uj-ofulnoss of thn concepts ami nodelr. to 
their-own current work. Several of the units of the I'Tnlstry shared 

their own current evaluation projects with the staff ami exchanr^ed ideas 

♦ — 
" as to the possibility of in-.proving their work >v applying, the no^iels 

nnd improving their utility by exposing then Lo the lieht or reality. 
^Equally encoura^ging was the hif>h '^op.ree of cooperation and fruitful 
collaboration in the group working sessions that combined menbers^.of 
various .deparLcntfi of the y-O, of universities and pe.'np.or i cos , and 
educational organizations. 

A ppraisal i 

• Instructor -^appraisal was positivp, prirarily because of the ^ - 
> ability bf the paJticirants to-applyf eva luat,. , and cridicallv c-nnin^- 

the usefulness of the theory and modks under varying conditions. 

Not all students, however, gave evidence o\ understand! nP, the 
usefulness of the models, whether due to a lack of ef'fective and 
appropriate instruction or n lack of participant" interest in the 
specific subject natter of prograiji and project evaluation. 

The participants LhorUu.lvcs rated the utiliLv of the weck'.s work 
using, the week's objectives -Is standards. (S<>a Append,ix f).) 

The first two evaluations concerned the utility of the CEPP and 
Discrepancy Models. An analysis, presentec^Jio the participants, 
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consisted of. the following: 

1. How well did you understand the model? 

Mean Pe rfectl y Very Well Well OK Mot at all 
.CEPP N=15 3.33 2 3 8 2 

;? 

Discrepancy 3.25 1 ^ 14 1 

N=20 . ^ • ■ 

r 

2. To what extent do you consider the model useful? 

' 'Mean Perfectly. Very Well Well OK Not at all 

CEPP N=15. 3.80 1 10 . ^ 

> . ■ ' 
Discrepancy 3.45 1 7 ^ l1 

■ N=20 

3. Have you thought^of ways to apply the model in your work? Please 
give examples. J 

14 ^ of 15 gave examples' with regard to the CEPP model. 

19 out of 20 replied with examples in regard to the discrepancy model 

4. You may have used the same or similar models in your work before 
attending the Seminar. From your experience, would yoi| be able to 
suggest modifications or improvements in the model s .presented? 
Please put down your suggestions. 

With regard to the CEPP model, 9 out of 15 made suggestions. 

With 'regard to the discrepancy model 11 out of ,20 made suggestions. 

One possible conclusion is that the participants were more 
positive toward the utility of the models than toward their feeling of 
understandlpg the model. This was supported by their ability to give ^ 
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examples of how one or anotlr^r of the models could be used in their work. 

The participants also demonstrated an ability to apply the models 
to new situations later in the course in .sucl^ a way as to sup.gest that 
they were perhaps overly modest in assessment of their understanding. 

Another factor may be the fact that the evaluation of the under- 
standing of^the models was requested immediately after, the instruction. 
It may be that after additional practice in application, participants 
become more self-confident in their ability to use t.he mg^dels and more 
experienced at critically appraising them. ^ 

Jhe second weekly evaluation by participanLs of the degree to which 
the week's, instructional objectives were achieved tends to confirm this 



view. 
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MATERIALS PRODUCED DISTRIBUTED-SECOND WEEK 
(See Appendix 5) 



? 



Title 

5.1 Desarrollo de'una teor/a de Evaluacif -Mauch 

5.2 Variables para una evaluaci<<n-Mauch 

5.3 Algunos puntos claves de la EvaluacioVMauch 

5.4 Aproximaciones a un estudio evaluative: una 

revisi^n-F .G . Caro 

5.5 -Fallas en la evaluacion educacional-E.G . Cuba 

5 Evaluadores Educacionales : 4^" modelo para 
. el Desarrollo de Tareas Orientadas a\la 
la posicion— Rice, Buser, y Ellisy 

5.7 Selected Reterences on CEPP Model 



Pages Distributed 

8 AO 

4 40 

'l 40 

8 40 

20 ^ft 

9 40' . 

1 40 
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LIST OF INSTRUMENTS USED AS EXAMPLES IN SEPIC SEMINAR 



1. Identified Teacher Corps Objective 

2. . Your teacher 

3. My class ^ ' * 

4. My school f 

5.. Questionnaire on Attitudes of New Teachers toward children 

6. Minnesota Teacher Attitude Inventory 

41 

7. Principal Interview 

8. Teacher-intern follow-up analysis 

9. Intern Assessment of Sensitivity training , - i ^ 

10. Follow-up questionnaire on dropouts from Teacher-Intern Program. 

11. Teacher-behavior Record 



12. Instructor Rating Form 

/ 

13. Instructional Consultant Checklist 

14. Intern interviews—attitudes and scliool relationships 
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EVALUATION OF INSTITUTIONS 
» 

Ob '|ectlves 

The third week was devoted to sone Iceas related to the evaluation" 
of Institutions. Stated ob.ic'ctlves for the week shortened by a, Friday 
holiday were: 

1. To present a point of view about the iinportance of evaluative 
study of institutions as institutions and as general social 
forces, and to stimulate a critique of that viewpoint. 

2. To suggest approaches to study of institutions as socW 
organization? with enphasis at administrative levels, and ^ 

2. To work with various schPires which contribute to institutional 
evaluatsion. 

Subjects and Topics' C overcd_. , " 

The majority of the seminar participants appeared to pei^eive insti- 
tutional evaluation as essentially the sarr.e as progran evaluation with the 
final test of effectiveness bcinr, the institutional product. .In order to 

focus on the institution a"_a institution, considerable effort was made 

g 

to separate it from its parts and from its product. 

For instance, the group" was asked to con.sider students as bcinf^ 
Included in "personnel" as lone, a.s they are cnrolbid in school. Th^s 
helped to emphasize the students' role in tl:e processes of institu- 
tional life and the fulfillnent of its mission. 

It was argued, too, that graduates or drop-outs were not the r,ole 
products of the educational enterprlze. T^ schools, ps institutions. 
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produce social pressures, influence fiscal policy, demand and use human 
resources, etc. Too, scho9ls have internal rationales and they cause 
personal and interpersonal behaviors, establish educational goals and ' 
alter goals seated at other levels. 

/The institution, then, is established to perform certain ^unctions 
in society. It will carlainly become a force on Its own and in its 
own interest. It therefore must be understood and evaluated in the light 
of itb'^ffectiveness as an instit^n in terms of how i.\ goes about its 

work. ^v^^^ jj 

Since' administration is key to instxWWH^^enance and change, 

its behavior: its decision-making processes and its efficiency must be 

Priorities' in a system of educational evaluation were suggested- 
iargely related to the kinds of data needed. A schematic presenta- 
tion "Contexto General de Un^ Inst^tuci.^ EduSativa" was made (see , 
Figure 1) and lectures and discussions used that schematic as a base 

early in the week. 

For purposes of consistency, participants were asked to view the 
Institution as " an organization 'of people, recognized as a positive 
force by the society; with objectives generally understood; with 
tradition and a future; and which can be identified as a place." We, 
then, wore concerned witl^-.■. school, a university, or n Ministry unit. 
A typical process of institutional evaluation, that of an^ accrediting 
- agency, was presented. This presentation emphasized the utility of the 
process in Inducing change and effecting improvement. This was seen 
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as the greatesj: value of evaluation the process utilized. Further 
emphasis was placed upon breadth of participation in the -process. 
V^enezuelan examples of self-evaluations were presented by ^participants . 

Because of the importance of institutional decision-making and the 
administrator '-s critical r.ole, a way to study the decision-making 
process was presented. This then became a part of presentation and dis- 
cussion around a second schematic; "Esquema de Recoleccion de Datos 
Sobre ^Espectfativas del Administrador Educativo y Congruencia con 
Programas^^ Preparacion," (Figure 2). The schematic emphasized the need 
to evaluate* a series of functions based upon a clear statement of. 
expectations regarding' t-asks, leadership style, needed skills, and 
decision-making. ^ 

Methods and Ac t ivitie s 

Once the basic concepts werfe presented, relatively litplie^ime' 
was spent in lectures. Presentations of Venezuelan exampPes of self- 
'evaluation were reported by participants representing a pedagogical 
institute, and. a university. Various group tasks were assigned and 
carried out (see Appendix 8). Presentations were informal and were 
frequently enriched by general discussion. 



Q utco nics 

The participants were active throughout the week — both as producers 
of group work and as critics of ideas and schematics presented". Some 
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discomfort was apparent at first with the concept of institutional 

evaluation as presented but they clearly understood the concept and 

expressed interest in its application. They were clearly unused to 

the idea of systematic evaluation^ of administrators. 

The idea of self -evaluat ion ^^^^ ^ost favor among the grdup, 

some of whom had experience in such projects. Presentations dealing t 

• with that kind of approach were particularly interesting to participants y 
/ * r • ' . " 

and group projects showed that they had basic understandings of the 

process. 

There was great demand for materials* related to institutional' ^ 
evaluation and much out-of •-class discussion with the staff. 

Again, ^s in the previous two weeks, the value of representation 
from a variety of institutions was evident-* A great deal of teaching 
was done bJT the more experienced participants. 

A ppraisal ' ^ - 

The participants were positive In their forma] evaluation of the 

W2ek*s work. .Then judgments related to the degree to which objectives 

were met were recorded on the following scale: 

1 2 3 4 5 . 

Perfectly Very Well Well Slightly Not at all 

A compilation of responses showed the following means: 

Objective 1 Mean 2.0 

2 2.0 

3 2.53 
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Co„».„ts showed .r..e„aou3 interest In the veek^s .h*e hut decrxed 
the a»ou„t of ti.c a.aUahU for appllcac^n of cho ideas presented, 
especially regarding self-evaluation modtrfs. 

The instructional staff supports the criticisn,. Much of the ^ 
rationale for ideas presented could not he presented and. therefore 
onLy an insecure base for implementation could be left behind. 
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CanWO GENEIV^L DE UNA IHSTITUCION 
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IHIRD WEKK - SAMPLES OF GROUP WORK 
(See Appendix 8) 



Title 

8.1 Application of Self-Evaluation Model 
Application of Self-Evaluation Model 

8.2 Coralsi($n Nacional de Iwaluacion, de Edup] 



an 
• 



8.3 Instituto Pedagogico (Caracas) 
Self-evaluation documents 



Group Pgs. 
k V 
2 1 
3 
A 



Dist . 

40 
40 



S9 



OVERVIEW ' 



Objectives 

^ It-was planned to devote the final week of the seminar to the 
^following objectives: 

1. Make specific applications, using previous week. 

r - 

2 Review principles, and concepts presented. j 

i " 

.3. Evaluate the seminar with respect" ta: i 

! 

a. Utility of content 



• b. Effectiveness of Instruction . \^ 

c. Individual understanding 
Subjects and Topics Covered ' , 

, An attempt was made to show the .interrelationship of the various 
models presented in each of the .hree categories of evaluation effort 
'discussed: personnel, program, and^^nstitutional . In general, sel^. 
evaluation (institutional) was used as the vehicle. 

Each model presented was reviewed briefly and 'attej^ts were made 
tb clear up recognizable misconceptions. _^ 

The only new substance for the week was a description of the 
Delphi Technique and its potential as a tool in establishing goals and 
evaluating processes and products. 

Methods and Activities 

. The participants continued to serve as informants and present appli-, 
• cations to the group. At the request of the participants, small group 

40 
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activities were curtailed and the^e was more discussion time 'as a 
"committee of the whole." 

Wc attempted use of incident and casfe study technique in relation 
to administrative problems In schools. , 



A major and most delightful activity was arranged by the particij)antrs 
for the instructors and other guests on Thut^sday evening of the final 
week. A dinner party was held at a club situated tiigh above Caracas- 
The food, view and excellence the company were all much appreciated 
by all of us. It was really quite an elaborate evening's entertainment; 
very warm, human, and on occasion hilarious. 



On Friday the closing ceremonies were held \'ith Prof, Aristofiolo 
Pe'fla making a few highly pertinent remarks and presiding over the 
distribution of certificates to AO participants. (See attached sample), 
At the same time a bottle of Venezuelan rum- and -a record of Creole music 
was presented to each of the four instruc t^>>$ . * ^ 



Outcomes and Appraisa l 

No forma comments were requested from the participants about 
objectives for the week. We expected that the group would focus on a . 
few items with which they wanted more intimate acquaincafice. This did 
t take place. Too, wc expected them to be interested in specific 
fforts to apply certain modols. Only a few appeared to be so inclined- 
The group preferred to remain together for dicussion purposes. 
Th?1n3T««X^rob3em during the last week was pure fatigue. All 
participants had >een carrying a full work load as well as working in 



\ 
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the seminar. By the middle of the last week, there wa3 much more 
interest in planning the party on Thursday night than in new material 
or application of old. "This was perfectly understandable and resulted 
in the above mentioned excellent party. 

The- social- em.ihasis of the latter part of week four had, it seemed" 
to us a very positive result. The group expressed ipterest in main- 
taining a working liaison and the development of joint efforts of evalua- 
tion. Some of the less sophisticated professionals became well acquainted 
with colleagues who can be very helpful to them as time goes by. 

That emphasis, too, demonstrated an ease and confidence in relation- 



ship to the instructors which was highly gratifying. It demonstrated, 
to our view, that our informal approaches to teaching were not only 
acceptable but approved. 

The results of evaluation fo the entire seminar will be found in 
a later section of the report under "Final Appraisal." 

* ' — - 1 

Activities Related to SEPIC 

During the course of the Seminar, we made ourselves available to in- 
dividual cfr groups among the participants as consultants. ^ ^ere in- 
vited, as. a group, to consult with three different elements of the 
Ministry of Education. As individuals, a total of twenty-one consul- 
tations were held related to specific problems of evaluation, advising 
participants on plans foj advanced academic study, and discussions 
about other programs needed or potential follow-up of SEPiC. 

One or more of the instructors made visits of an infonnal nature 
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to several of the entitlci- lepresenteci amorig participants. 

Upon returning to campus, we have fo^lowed-up on many requests for 
information by potential future studeiits from among participants. 



Final Appraisal^ \ 

J- \ 

Formal evaluation by participants included response to two,' separate 
instruments. The first was an attempt to arrive at pa^rtic^pant per- 
ception/ of "before and after" competence and confidence in the field 
of evalua. ,on. The questionnaire was administered during the first week 
of the seminar and again on the last day. 



They were asked to answer the following questions on a scale of 
5 with 1 being the most positive response: 

1. 6 Que conocimientos posee usted sobre la teorjfa, la pr^ctica y 

los problemas de la evaluaci<^n de programas educativos? . 

2. i Que habilir^ad posee usted para planear y llevar a cabo, la 

evaluacion de programas educativos? 

3. cQue^grado de confianza tiene usted en mejorar su habilidad 

para evaluar programas educativos? 



The following is a charting of results: 

Question I First response Mean 3.00 32 respondents 

Final response Mean 2.23 26 respondents 

Question l - First response Mean 2.96 32 respondents 

Final response Mean 2.23 26 respondents 

Question 3 - First response Mean 1.72 32 respondents 

Vinal response Mean 1.27 26 respondents 
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Participants, as a group, reported substantial growth. Individually, 
21 reported improvement in Question 1;19 in Question 2; and 10 in 
Question 3. One participant reported a negative result for himself on 
all three questions. Curiously, he also reported a Iocs of confidence 
in his ability to improve as an evaluator. 

The second evaluation was made on the final day of the seminar. 
^ Participants were asked. to evaluate the degree to which we had reached 
the three major objectives of the seminar. Further, they were requested 
to 'make res ponses on three dimensions; content, instruction, and per- ^ 



sonal knowledge. 'The following charting shows the results: 



Objectivos'x^ 



1. Obtener it^arco de 
referencia sobre 
la evaliiacl^n de 
personal, curri- 
culum, y instit. 



2. Presentar una 
vision de prin- 
cipios,probl"emas 

y ejemplos de me 
todologlas de la 
evaluacion . 



3, Aplicar teona, 
modelos, e in- 
strumentos a la 
situacion educa- 
tiva Venezolana 



Perf ectamente Muv Bien Bien Poco Nada V 



Utilidad deL 
Contenido 



Mean 1 . 90 
Range 1-3 
Mode 2 



Mean 1.75 
Range 1-3 
Mode 1 



Mean 2.07 
Range 1-4 
Mode 1 



TOIALS 



Content 
.resul ts 



Mean ;i.90 
Range 1-4 
Mode 2 



Ef ectividad 
de Tnstif, 



Mean 2.43 
Range 1-4 
Mode 2 



Mean 2.41 
Range 1-4 
Mode 2 



Mean 2.65 
Range 1-4 
Modes 26(3 



Instruction 
results 



Mean 2.49 
Range 1-4 
Mod e 2 



Ayuda de Cono-- ^Totals 
cimionto Persona] 



Mean 2.21 
Range 1-4 
Mode 2 



Objective 1 results 
Mean 2.1^ 
Range 1-4 
[Made 2 



Mean 2.07 
Range 1-4 
Mode 2 



Objective 2 results 
Mean 2 . 04 
Range 1-4 
^ode 2 



Mean 2.14 
Range 1-4 
Mo,des 1,2,&3 



Personal Know- 
led>4e results 



Mean 2.14 
Range 1-4 
Mode 2 



Objectives 3 result 
lean 2,29 
Ran^e 1-4 
iode 3 
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consistently, the annlysis shows that the" content of the seminar 
was considered to have clear utility to the participants and that it^ 
contributed- substantially to their knowledge. Responses were heavily 
on the positive side with the only reluctance showing up in relation 
to Objective 3; referring to application to the Venezuelan situation. 

'Our experience is ^that participant evaluative responses? parti- , 
cularly when participants are experienced professionals, as these were, 
have a tendency to cluster around the midpoint on the evaluative scale. 
Thus, we fully expected that means woul/ fall between 2.75 and 3.25 
and m^es would at 3. We were most gratified at receiving responses at 



a mubh more positive level. 

The final evaluation instrument also contained open-ended questions. 
In responding to those questions, participants made many suggestions 
for follow-up activities. They clearly saw. SEPIC as a preliminary step 
to the development of a cadre of people well prepared in evaluation method 



and techniques. 

Participants we^e virtually^ unanimous ^in making suggestions related 

to the following: ■ ' 

1. The continuation of seminars on evaluation-they wished for 
programs which operate at^different levels of sophistication 

^nd in different evaluation categories; a regularized schedule 
of special programs; conduct o£ programs in schools. 

2. Maintaining the participants as a group-they expressed a desire 
to maintain contact with other participants; to be used by their 
employers in evaluative activities; to be used as a group in 
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evaluation policy^ development; to be permitted to conduct infor-, 
mation sessions with teachers; to develop models SlJdCific to 
Venezuela's needs; and to be permitted to influence preconditions 
required for a systematic program of evaluation. 
3. The need for centralized coordination and policy—they felt the need 
for a defined policy on evaluation; to coordinate evaluation efforts 
in different elements of the Ministry; to develop and maintain a 
documentation center on evaluation; and to have a 2-day meeting 
of directors and participants to make ba^ic decisions. 

In addition, comments i\icluded suggestions about seminar management 
such as: "should be shorter and more concentrated,"; "a quieter, more 
secluded site should be chosen," etc. 

In general, then, the seminar was seen as relevant, well conducted, 
and personally fruitful. It was considered as only a beginning and there 
was much interest in continued effort. There appeared to be rather 
general dissatisfaction with current coordination of evaluation programs 
and with the state* of the art in Venezuela. 

One -of the be^ bits of evidence of the reception of the seminar 
by participants was the average daily attendance of nearly 30 people- 
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PART III 
CONCLUSIONS AND RECOI^IENDATIONS 



- "In this section of the report, 'the instructors of SEPIC present 
their own views about the seminar and about reasonable next* steps. 



Management 

We were impressed by the degree to which the seminar was well or- 
ganj;^~d7' prep"are'd"f'0^rr^nTi-~STipp'C^ -coordiTiatlotr between the— - 

Ministry of Education and USAID/Vene^ela was good as were preliminary 
documentation' and orientation. la our considerable experience with 
such programs, SEPIC presented fev;er problems, less confusion, and more 
enjoyment than any previous experience. ^ ^ 

Our major criticism is related to the locale. ^We are convinced 
that the space occupied was the best available at the Instituto de 
Mejoramiento Profesional and certainly the aid given us by its director 
and his staff was superb. However, the noise level was very discon- 



certing to' instructors and participants and the long hours in uncom- 
fortable seats must have been nearly intolerable. 

The assistance wc received in producing additional materials and in 
translations was excellent. Most of all, we appreciated the cordiality 
apparent on all sides, i • ^ 
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Participiin ts 

^ The participants were, without exception, the kindest people one 

could imagine. They accepted our infornality and our frequent language 
atrocities with patience and rood humor. They v/ere helpful vrit»> their, 
suggestions and generous with their teachinp. talonts. They actively 
participated in discussions, worked hard in snail groups and generally 
impressed us with their dedication and conpetence. 

In terns of preparation for such a seminar, the range aTnon<> par- 
ticipants was great. This heterogeneity .forced us to alter certain 
of our approach^'^d helper^ creaY(^ perioT^ f~bo r ed o"rrfor" sore^ anc! 
incomprehension for others. 

Too, the group represented a variety of entities. It was djffictilt 
to adapt our presentation and concepts to Venezuelan situations because 
there were several views' of reality. All this made us less he^oful In 
applications to specific needs .tlian ^e had hoped to be. Theoretically, 
we could have served that purpose by other consultations but participanl^s , 
having to maintain their vork, could not invite ':s for those consultations 
often enough. 

Several participants, because of their ';ork load were ^ften unable 
to attend enough consecutive sessions to receive a cumulative effect. 
They, thun, received only bits and pieces of sotro content— a discouraging 
thing to happen in the learning process. 

Ve should point out that the representation of various entities 
in such a program has" some positive aspects. Tt ends to break do\m 
departmentalized se^larlpm and to give partici ants an acquairtance 
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with individuals who may \ useful as consultants to their particular 
interests. 



Seminav Content and Method 

SEPIC was scheduled for far t\o short a time to adequately cover 
the range of topics scheduled and fo\too long a time to assure constant 
attendance of individual, participants \ The content for such programs 
should be more focused and for shorter. pViods . 

We felt that our presentations were pitched at a lower level of 
sophistication than would have been desirable for the benefit of 
";;;;iuation m Venezuela. Gi^;^el^itiH8^nious nature o-f-rhB-grour^and 

1^ „^f- pvpn in retrospect, know what we would 
the time limitations we do not, even in retru i> 

do differently if we could start again., 

„e should have had more problem, specific to Venezuela to analyze 
and develop but. again, timing and^the participant mix ma^. that impoS- 
s'ible. 

. • our approach to teaching and the variety of techniques employed 
appeared to be acceptable to the participants. 



Instructional Staffing 

There are some difficulties in providing instructors such a.our^ 
selves, to seminars like S.PIC. Tc is rare that an institution can re^ 
lease senior professors (four of them) to participate in programs off 
campus for a month. We are all heavily committed on campus and -our ab- 
sence results in considerable disruption of *classes,^graduate student 
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advising, ate. It In much csler to 1,.. nvaMnblo for one or tvo wcel-n 
or for a full term. '"Even in the case of a one-term absence professional 
dislocations exist and personal dislocations are nagnified. 

We feel that instructional teams could include; v.'ithout harm to • 
programs to be conducted, perhans fewer senior professors and nore 
advanced graduate students in appropriate fields.. Quite frankly, the ^ 
senior professor is often a very self-centered person. He has his ■ 
specializations and his commitments and he is interested in furthering 
those considerations. All of us are committed to international 
-deve-l^pment--wo^k-bul--»<^-can-^f-£ard^lX^IL^a gi°" ^° par ticipate^^ _ 



essentially teaching activities abroad. 

On the other hand, advanced graduate students are often ea?,er to 
participate, are excellently prepared substnnti-oly, and are interested 
in the accumulation of experience already held by senior professors. 

Ri:C0:-C!r,NDAT10HS 

In general,' v,e are in accord with the Government of Venezuela '.^^ 
interests and efforts toward the capacltation of its professionals. 
We hope that our : recommendations uill be helpful, not only in terms' 
of next steps in ^ field of evaluation, but in nlanninr. the vholc 
range of anticipated activities. Ue shall, even uith that hone in mind, 
confine our specific suggestions to new efforts in evaluation programs. 
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Training of Eva Uin tor s 

VJe recommend that : , ' ' 

1. Specific efforts be continued to prepare a large number 
of professionals to conduct evaluation programs 

2. Selected participants from SEPIC be made into a cadre to 
organize and plan introductory in-service programs for 

teachers and school administrators. 

I 

3. Competence- in evaluation techniques be viewed as ancillary 

I 

to other professional capabilities and not as a strict 

s p ec-ia-l-i-za-tiefH 



4. Selected personnel be provided becas for advanced -study in 
teacher education, student personnel services .school 
administration, counseling and guidance, and curriculum 
with strong emphasis on data collection and evaluation 
techniques. •• 

•r 

Training Approaches 

We recommend that : 

1. A regularised schedule of seminars be planned over as 
extended a period of time as possible with both intro- 
ductory and advanced levels represented. 

2. Seminars operate for not more than two weeks and concern 
themselves with a single theme ( i.e., pprsonnel or 
institutions or program) 



I 

Ay 

4 

Participants be grouped according to Igvel of sophisti- 
cation to the degree possible and representative of a 
variety of entities. 

If at all possible, participants be released frpm regular 

V 

tasks and committed full-time to seminar study with tipie\ 

for field applications of new skills, »^ 

I 

Seminars b^ supplemented by advanced formal study for* 
selected individual^ including "internship** arrai)gements 
with such agencies as learning research laboratories, 
research c^piHmaLS-Q f public-schaols , schoplLstAidy 



"councils, curriculum centers, state departments of 
of education, accrediting agencies, etc , 
Seminars be staffed by Venezuelans and visitors with 
visiting teams made up of one senior professor and needed,, 
numbers of advanced graduate students of appro^vi^te ' 
preparation , \ 
The specific problems of any one entity be attacked by 
employing a consultant to work directly with the entity 
staff on the job rather than in a formal seminar, 
A continuing liaison (a person) be developed to relate 
concerns about evaluation in the Ministry of Education 
to the staff resources of tlie University of Pittsburgh " ^ 
(and/or others) to plan training activities, and to coor- 
dinate Evaluation efforts. 
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9- Once a continuing program ot evaluation in any category 

is underway, a consultant be employed to work with the staff 
over a period of one or two yca^s, utilizing a series 
of short term visits coinciding with various program stages: 
planning, data^cqllection (instrumentation), data analysis, 
and implementing policy changes shown to be needed as a 
result of the evaluation, ^ 

feel that ,the US/Venezuela partnership in findhcing special 



programs such as SEPIC is a~vdry positive force and hope that it will 
Continue indefinit"elyT" These parXneTrsrnray^wish- ta consldet-the-possl-^ 
bility of creating a finance pool and a service contract arrangement with 
the University of Pittsburgh- We recognize the reluctance of AID to 



en 



ter into institutional contracts but feel that a systematic second 



look should be taken. A contract would assure Venezuela of service of 
the 'kinds and at times needed and allow the University to plan its 
contributions overman exlended time period. The University as well as 
individual professors would be committed to the effort. ^ 



We wish to again express our interest in a close and continuing 
association with education in Venezuela. We hope that SEPIC x^as valuable 
to participants and to the purpose of the Ministry of Education. 
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